Suivi tridimensionnel de la main et reconnaissance de gestes pour les Interfaces Homme Machine. (Three-dimensional hand tracking and gesture recognition for human-computer interaction)
نویسنده
چکیده
The proposed work is part of a project that aims at the control of a videogame based on hand gesture recognition. This goal implies the restriction of real-time response and the use of unconstrained environments. In this paper we present a new algorithm to track and recognise hand gestures for interacting with a videogame. This algorithm is based on three main steps: hand segmentation, hand tracking and gesture recognition from hand features. For the hand segmentation step we use the colour cue due to the characteristic colour values of human skin, its invariant properties and its computational simplicity. To prevent errors from hand segmentation we add the hand tracking as a second step. Tracking is performed assuming a constant velocity model and using a pixel labeling approach. From the tracking process we extract several hand features that are fed into a finite state classifier which identifies the hand configuration. The hand can be classified into one of the four gesture classes or one of the four different movement directions. Finally, the system’s performance is evaluated by showing the usability of the algorithm in a videogame environment.
منابع مشابه
Un système de segmentation automatique de gestes appliqué à la Langue des Signes (An automatic gesture segmentation system applied to Sign Language) [in French]
RÉSUMÉ De nombreuses études sont en cours afin de développer des méthodes de traitement automatique de langues des signes. Plusieurs approches nécessitent de grandes quantités de données segmentées pour l’apprentissage des systèmes de reconnaissance. Nos travaux s’occupent de la segmentation semi-automatique de gestes afin de permettre d’identifier le début et la fin d’un signe dans un énoncé e...
متن کاملVisual interpretation of hand postures for human-machine interaction. (Interprétation visuelle de gestes pour l'interaction homme-machine)
متن کامل
Voicephone: an Interactive Vocal Server for Telephone Numbers
VoicePhone is a dialogue system, designed to recognize telephone numbers over the public telephone network. This report describes the basics needed for this program, including theory on speech recognition, human-computer interaction and user friendly dialogue design. Next, the design of the application is described, including the setup of a Wizard of Oz environment. This environment is used dur...
متن کاملSpeech Recognition by Intelligent Machines
Le but de la technologie “interaction homme-machine” (HM) est de créer des machines artificielles intelligentes capables d'interagir avec les êtres humains par l'intermédiaire de leurs voix. Les progrès rapides dans les différents domaines tels que les calculs numériques, le traitement des signaux et l'évolution des méthodes statistiques au cours des dix dernières années ont contribué énormémen...
متن کاملHuMan vision PercePtion in built environMent Applying image-based approach for architectural cue recognition
This paper first presents a review on visual perception in the built environment and human vision simulation. Followed by the description of the Standard Feature Model of visual cortex (SFM), an architectural cue recognition model is proposed using SFM-based features. Based on the findings of the experiments it can be concluded that the visual differences between architectural cues are too subt...
متن کامل